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DESCRIPTION 

MOVING PICTURE PREDICTION METHOD, MOVING PICTURE CODING 
METHOD AND APPARATUS, AND MOVING PICTURE DECODING 
METHOD AND APPARATUS 

5 

Technical Field 

The present invention relates to a prediction method of a pixel 
value in a moving picture, and particularly to a prediction method for 
performing temporally scaling processing based on two pictures. 

10 

Background Art 

Generally in moving picture coding, the amount of 
information is compressed using redundancy in spatial direction and 
temporal direction that a moving picture has. There is inter picture 

15 prediction coding as a method for using the redundancy in temporal 
direction. In the inter picture prediction coding, a temporary 
preceding picture or a temporary subsequent picture is used as a 
reference picture when a picture is coded. Then, motion amount is 
detected from the reference picture and the amount of Information 

20 is compressed by removing redundancy in spatial direction toward a 
difference value between a picture to which motion compensation is 
performed and a picture to be coded. 

In such a moving picture coding method, a picture that does 
not perform inter picture prediction coding, or equivalently, that 

25 performs intra picture prediction coding is called an I picture. Now, 
a picture means one unit of coding including both of a frame and a 
field. Additionally, a picture that performs the inter picture 
prediction coding with reference to one previously processed picture 
is called a P picture while a picture that performs the inter picture 

30 prediction coding with reference to two previously processed picture 
is called a B picture. 

As for a B picture, its pixel values are predicted (also called 
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"weighted prediction") and its motion vector is calculated based on 
two reference pictures and by scaling processing (a proportional 
calculation based on the distances among the B picture and the two 
reference pictures). As the distances among the pictures, there are 
5 a difference In time information that the pictures have, a difference 
In picture numbers assigned to each picture, and a difference in 
Information showing the display order of pictures. 

FIG. 1 shows an example of prior art that indicates process for 
calculating predictive pixel values in a B picture by weighted 
10 prediction based on two reference pictures. As shown in the figure, 
a predictive pixel value P Is determined by weighted addition using 
the pixel values PO and PI of two reference picture blocks 1 and 2. 
Both of weighting coefficients a and b in the formula are, for 
example, 1/2. 

15 FIG. 2 and FIG. 3 show other examples that indicate the 

process for calculating predictive pixel values in a B picture (a block 
to be coded) by performing scaling based on two reference pictures 
(blocks land 2) (for example, refer to Joint Video Team (JTV) of 
ISO/IEC MPEG and ITU-T VCEG Joint Committee Draft 2002-05-10, 

20 JVT-C167 11.)- Here, FIG. 2 shows an example when a B picture (a 
block to be coded) refers to a forward picture (block 1) and a 
backward picture (block 2) while FIG. 3 shows an example when a B 
picture (a block to be coded) refers to two forward pictures (blocks 
land 2). By the way, WO and Wl in the figures are weighting 

25 coefficients in scaling processing (here, weighted prediction of a 
pixel value). WO is a weighting coefficient by which the pixel value 
in the block 1 is multiplied while Wl is a weighting coefficient by 
which the pixel value in the block 2 Is multiplied. WO and Wl are 
expressed by the following formulas. 

30 wo=(l28x (Tl -T))/(T1-T0) ...(Formula 1) 

Wl = (1 28 X (T-T0))/'(T1 -TO) ...(Formula 2) 

Here, T, TO, and Tl are time (such as a time stamp) added to 
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the block to be coded, the forward reference block 1 and the 
backward reference block 2, respectively. 

At this time, the pixel value P in the block to be coded is 
expressed by the following formula. 
5 P=(POx W0 + P1 X wH-64)»7 ...(Formulas) 

Here, means a bit sift to the right direction. In other 
words, "»7" means ''-=-(2 to the 7th power)". In addition, the 
above-mentioned Formula 3 Is used when the pixel value indicates 
the value of a luminance signal. When the pixel value indicates the 
10 value of chrominance, the chrominance is expressed by the 
following formula. 

P=128+((P0-128) X W0+ (PI— 128)xW1+64)»7... 
(Formula 4) 

FIG. 4 is a flowchart showing concrete calculation steps using 

15 these formulas. After Time T, Tland TO and pixel values PO and PI 
are obtained (Step S401), whether Time Tl is equal to Time 0, in 
other words, whether the denominator of the weighting coefficients 
WO and Wl in Formulas 1 and 2 is 0 or not is judged (Step S402). 
When the denominator Is 0 (Yes; Step S402), it is deetermined that 

20 the weighting coefficients WO and Wl are both 128 (Step S403). 
When the denominator is not 0 (No; Step 402), the weighting 
coefficients WO and Wl are calculated according to 
above-mentioned Formulas 1 and 2 (Step S404). Lastly, the 
predictive pixel value P In the block to be coded is calculated using 

25 the weighting coefficients WO and Wl and the pixel value PO in the 
reference blockl and the pixel value PI in the reference block 2 
according to above-mentioned Formula 3 or Formula 4 (Step S405). 
As described above, the predictive pixel value in the block to be 
coded is calculated using the pixel values in the two reference blocks 

30 and performing temporal scaling. 

Incidentally, in temporal scaling processing like this, divisions 
are necessary to calculate weighting coefficients as 
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above-mentioned Formulas 1 and 2 show. Since the resource 
necessary for divisions is larger than that necessary for 
multiplications, it is common to calculate reciprocals of divisions in 
advance, store them In a look-up table and the like and perform 
5 multiplications using the reciprocals In stead of performing 
divisions. 

Note that the block 1 and the block 2 in Figs. 1 to 3 are P 
pictures but It is acceptable that the blocks are I pictures or B 
pictures and are not necessarily P pictures. 

10 In the method using the reciprocals calculated In advance, 

however, when the kinds of divisions In formulas for calculating 
weighting coefficients are many, the kinds of reciprocals calculated 
in advance also become many. For example, when possible values 
of TO and Tl shown in Formulas 1 and 2 are 30 ways, respectively, 

15 by a simple calculation, 900 ways of divisions are necessary for 
calculating reciprocals and the reciprocal calculation amount 
becomes extremely large. Further, there is another problem that 
large storage capacity of the look-up table and the like that store the 
reciprocals Is necessary. 

20 Moreover, when the denominators (the devisors of the 

weighting coefficients) In above-mentioned Formulas 1 and 2 
become small, the weighting coefficients (the quotients) become 
extremely large and there is a problem, for example, that the 
predictive pixel values cross a value that can be expressed by 16 bits. 

25 Therefore, for example, a 32-bit calculation becomes necessary and 
since the significant digit number necessary for the calculations 
increases, the size of a calculation apparatus becomes large. 

Disclosure of Invention 

30 In view of the foregoing, it is an object of the present 

Invention to provide a moving picture prediction method and the like 
that enable the storage capacity of the memory to be small In a 
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prediction of a moving picture by temporal scaling processing and 
when the reciprocals of the divisors used there are calculated in 
advance and are stored in memory. 

Additionally, it is another object of this Invention to provide a 
5 moving picture prediction method and the like that enable the 
calculations In the prediction of a moving picture by the temporal 
scaling processing to be a small size without increasing the 
significant digit number necessary for the calculations. 

To achieve the above-mentioned objectives, the moving 

10 picture prediction method according to the present invention is a 
moving picture prediction method for predicting pixel values in a 
picture that forms a moving picture based on pixel values in two 
reference pictures, the method comprising: a first parameter 
calculation step of calculating a first parameter corresponding to a 

15 distance between a current picture and a first reference picture; a 
second parameter calculation step of calculating a second parameter 
corresponding to a distance between the first reference picture and 
a second reference picture; a first judgment step of judging whether 
a third parameter calculated based on the first and the second 

20 parameters Is included in a predetermined range or not; a first 
prediction step of calculating pixel values in the current picture by 
scaling based on the first and the second parameters and pixel 
values in the first and the second reference pictures when a result of 
the judgment in the first judgment step shows that the third 

25 parameter is included in the predetermined range; and a second 
prediction step of calculating pixel values in the current picture by 
scaling based on predetermined values and pixel values in the first 
and the second reference pictures when a result of the judgment in 
the first judgment step shows that the third parameter Is not 

30 included in the predetermined range. 

Here, the scaling processing is the processing for obtaining 
each weighting coefficient when the pixel value in a current picture 



is calculated from the pixel values in two reference pictures. 

Hereby, a limit is put on the third parameter that is one of the 
values of the weighting coefficients in the scaling processing. 
When the weighting coefficients are within a predetermined range, 
5 the scaling processing is performed using the weighting coefficients 
but when the weighting coefficients are out of the predetermined 
range, the weighting coefficients are made to be predetermined 
values and the scaling processing using the weighting coefficients is 
performed. Therefore, when the pixel value in a current picture, it 
10 is always possible to calculate with a predetermined significant bit 
number. 

Moreover, it is preferable that the moving picture prediction 
method according to Claim 1 further comprising: a second judgment 
step of judging whether the first parameter is included in a 
15 predetermined range or not, wherein the second prediction step is 
executed when a result of the judgment in the second judgment step 
shows that the first parameter is not included in the predetermined 
range. 

Hereby, a limit is put on the first parameter that is the value 
20 of a divisor in the scaling processing. When the divisor is within a 
predetermined range, the processing described above is performed 
further judging whether the weighting coefficient identified by the 
divisor is included in the predetermined range. On the other hand, 
when the divisor crosses the predetermined range, the scaling 
25 processing is performed with a predetermined value as the 
weighting coefficient. Therefore, when the pixel value in a current 
picture is determined, the calculation amount for calculating and the 
memory amount for storing the reciprocals of the devisors are 
limited to be small. 
30 Furthermore, the moving picture prediction method according 

to Claim 1 further comprising: a third judgment step of judging 
whether the second parameter is included in a predetermined range 
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or not, wherein the second prediction step is executed when a result 
of the judgment in the third judgnnent step shows that the second 
parameter is not included in the predetermined range. 

Hereby, a limit is put on the second parameter that is the 
5 value of a multiplier in the scaling processing. When the multiplier 
is within a predetermined range, the processing described above is 
performed further judging whether the weighting coefficient 
identified by the multiplier is included in the predetermined range or 
not. On the other hand, when the multiplier crosses the 
10 predetermined range, the scaling processing is performed with a 
predetermined value as the weighting coefficient. Therefore, when 
the pixel value in a current picture is determined, the calculation 
amount for calculating the reciprocals of the multipliers is limited to 
be small. 

15 In addition, the present invention can be realized not only as 

the motion vector prediction method like this but also as a motion 
vector prediction apparatus using the steps included in the moving 
picture prediction method like this as means, moving picture coding 
method and apparatus as well as moving picture decoding method 

20 and apparatus, and a program for causing a computer to execute 
these steps. Then, the program like this, needless to say, can be 
distributed through a recoding medium such as a CD-ROM and a 
transmission medium such as Internet. 

As is apparent from the above explanation, the moving vector 

25 prediction method according to the present invention makes the 
scaling processing using two reference pictures more efficient. 
Hereby, the calculation amount and the storage capacity 
accompanying the scaling processing are reduced. 

In other words, the memory size of the look-up table and the 

30 like is reduced. The look-up table stores the number of the 
reciprocal calculations and the reciprocals required to avoid the 
divisions for calculating the weighting coefficients in generation of 



-7- 




predictive pixel values and motion vectors. Furthermore, the 
scaling processing is performed with a predetermined significant bit 
number (16 bits, for example), enlargement of a circuit size Is 
avoided. 

5 

Brief Description of Drawings 

FIG. 1 is a diagram showing an example of prior art indicating 
a processTo? calculating predictive pixel values in a B picture with 
the weighted prediction based on two reference pictures. 
10 FIG. 2 is a diagram showing an example when a B picture (a 

block to be coded) refers to a forward picture (block 1) and a 
backward picture (block 2). 

FIG. 3 is a diagram showing an example when a B picture (a 
block to be coded) refers to two forward pictures (blocks land 2). 
15 FIG. 4 is a flowchart showing the steps of a conventional 

weighted prediction. 

FIG. 5 Is a block diagram showing the structure of the moving 
picture coding apparatus according to one embodiment using the 
moving picture prediction method according to the present 
20 invention. 

FIG. 6 is a flowchart showing processing steps of a weighted 
prediction by the motion compensation coding unit In FIG. 5. 

FIG. 7js a flowchart showing significant processing steps of a 
size reduction of the look-up table required to avoid divisions to 
25 calculate the weighting coefficients. 

Figs. jBA ^nd 8 B are flowcharts showing concrete examples of 
the judgment processing (Step S70) in FIG. 7. 

FIG. 9 is a flowchart showing processing steps of performing 
the weighted prediction with a predetermined significant bit number. 
30 Figs. lOA and IQ B are flowcharts showing concrete examples 

of the judgment processing (Step S90) In FIG. 9. 

FIG. 11 Is a block diagram showing the structure of the 
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moving picture decoding apparatus according to one embodiment 
using the moving picture prediction method according to the present 
invention. 

FIG. 12 is an illustration for realizing the moving picture 
5 prediction method, the moving picture coding/decoding method 
using a flexible disk that stores a program for realizing the structure 
of the moving picture coding apparatus or the moving picture 
decoding apparatus. 

FIG. J^is a block diagram showing an overall configuration of 
10 a content supply system for realizing content distribution service. 

FIG. l^is a diagram showing the cell phone using the moving 
picture prediction method, the moving picture coding apparatus and 
the moving picture decoding apparatus. 

FIG. j^is a diagram showing the cell phone using the moving 
15 picture prediction method, the moving picture coding apparatus and 
the moving picture decoding apparatus according to the present 
invention. 

FIG. 15 is a block diagram showing the structure of the cell 
phone according to the present invention. 
20 FIG, 16 is a block diagram showing an overall configuration of 

a digital broadcasting system according to the present invention. 

Best Mode for Carrying Out the Invention 

The moving picture prediction method according to the 
25 present embodiments of the present invention will be explained in 
detail below with reference to the figures. 

(The First Embodiment) 

FIG. 5 is a block diagram showing the structure of the moving 
30 picture coding apparatus according to one embodiment using the 
moving picture prediction method according to the present 
invention. 
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The moving picture, coding apparatus includes picture 
memory 101, a predictive residual coding unit 102, a bit stream 
generation unit 103, a predictive residual decoding unit 104, picture 
memory 105, a motion vector estimation unit 106, a motion 
5 compensation coding unit 107, a motion vector storage unit 108, a 
difference calculation unit 110, an addition calculation unit 111, a 
switch 112 and a switch 113. 

The picture memory 101 stores moving pictures inputted 
picture-by-picture basis in display order. The motion vector 

10 estimation unit 106 uses coded decoding picture data as a reference 
picture and performs estimation of a motion vector that shows the 
position predicted to be optimum in the research area in the picture. 

The motion compensation coding unit 107 determines a 
coding mode of a block using a motion vector estimated by the 

15 motion vector estimation unit 106 and generates predictive picture 
data (predictive pixel values) based on this coding mode. For 
example, in the case of an inter picture predictive coding mode using 
two reference pictures, the motion compensation coding unit 107 
obtains pixel values in two reference blocks from the two reference 

20 pictures using the motion vector estimated by the motion vector 
estimation unit 106 and generates predictive picture data. In other 
words, a weighted prediction of a pixel value is performed by 
characteristic scaling processing according to the present invention 
and the pixel value in the block to be processed form the pixel values 

25 in the two reference blocks. Furthermore, the motion 
compensation coding unit 107 has a look-up table that associates 
and stores the value corresponding to the distance between a first 
reference picture and a second reference picture (a value limited to 
a predetermined range), and Its reciprocal. The motion 

30 compensation coding unit 107 performs the scaling processing with 
reference to this look-up table. 

The motion vector storage unit 108 stores motion vectors 
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estimated by the motion vector estimation unit 106. Tine motion 
vectors stored in tinis motion vector storage unit 108 are referred to, 
for example, in the case of a temporal direct mode that predicts a 
motion vector of a block to be processed by performing the scale 
5 processing to a motion vector that a reference picture has. The 
difference calculation unit 110 performs a calculation on the 
difference between picture data read out by the picture memory 101 
and predictive picture data inputted from the motion compensation 
coding unit 107 and generates predictive residual picture data. 

10 The predictive residual coding unit 102 performs coding 

processing such as frequency conversion and quantization to 
inputted predictive residual picture data and generates coded data. 
The bit stream generation unit 103 performs variable length coding 
and the like to inputted coded data and generates a bit stream by 

15 adding information on a motion vector and a coding mode Inputted 
from the motion compensation coding unit 107. 

The predictive residual decoding unit 104 performs decoding 
processing such as frequency Inversion and inverse quantization to 
inputted coded data and generates decoded difference picture data. 

20 The addition calculation unit 111 adds decoded difference picture 
data Inputted from the predictive residual decoding unit 104 and 
predictive picture data inputted from the motion compensation 
coding unit 107 together and generates decoded picture data. The 
picture memory 105 stores generated decoded picture data. 

25 Next, a characteristic operation of the moving picture coding 

apparatus constructed as described above is explained. Here, 
generation of a predictive pixel value in a B picture by the motion 
compensation coding unit 107 or weighted prediction is explained as 
an example referring to Figs. 2 and 3. 

30 The motion compensation coding unit 107 calculates 

predictive pixel values in a block to be coded based on the following 
formula. 
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P = PO+ ((PI — PO) X BWD) LWD ...Formulas 
Here, BWD and LWD are values identified by the following 
Formulas 6to9. 

BWD0=((T-T0)«7)X(T1 -TO) ...Formula 6 

5 Here, means a bit sift to the left direction. In other 

words, ''«:7" means " x (2 to the 7th power). 

LWD0 = Cell(log2(1 + (abs(BWD0)»7)) ...Formula 7 
Here, the function Ceil (x) is a function that rounds x to the 
integer that is x or more and closest to x. The function abs (x) is a 
10 function that returns the absolute value of x. 

BWD = BWDO»LWDO ...Formula 8 

LWD = 7-LWD0 ...Formula 9 

By the way, as is shown in Formula 7, LWDO also means the 
number of bits of the Integral value of abs (BWDO) »7. 
15 As is apparent from the above-mentioned formulas, in the 

present embodiment, when a pixel value can be expressed by 8 bits, 
above-mentioned Formulas 6 to 9 are all 16-bit calculations. 
Therefore, it is guaranteed that the scaling processing shown in 
above-mentioned Formula 5 is performed within the range of the 
20 significant bit number of 16 bits. In other words, weighting 
coefficients are limited by above-mentioned Formula 8 so that the 
multiplications of above-mentioned Formula 5 do not cross the 
significant bit value of 16 bits. Hereby, weighted prediction of a B 
picture is always realized within the significant bit number of 16 bits. 
25 In addition, it is acceptable to calculate BWD and LWD In advance 
and store them In a look-up table at the starting time point of a 
picture or a slice to reduce processing amount. 

Note that it is possible to apply another limitation besides the 
above limitation In the present embodiment to reduce the number of 
30 calculations to obtain weighting coefficients. The other limitation is 
that when the reference picture of the block 1 is not the first picture 
in a second reference list (list 1), a default weight coefficient is used. 
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Here, the first reference picture In the second reference list is the 
reference picture to which an index 0 is added in the second 
reference list. 

Here, a reference list is a row of relative numbers (indices) to 
5 identify reference pictures and a first reference list and a second 
reference list are used to Identify two pictures to which a B picture 
refers. The first reference list Is a reference list for the first motion 
vector and Is usually used for forward prediction; the second 
reference list is a reference list for the second motion vector and is 

10 usually used for backward prediction. An Index with a small 
number is usually allocated to a reference picture that has large 
pixel correlation with a picture to be coded and the smallest number 
is 0. Additionally, the default values of the weighting coefficients 
are preferably BWD=1 and LWD=1. But It Is acceptable that when 

15 the value of LWDO Is larger than 7, different default values, for 
example, BWD = 1 and LWD=0 are configured. 

FIG. 6 is a flowchart showing processing steps of the weighted 
prediction by the motion compensation coding unit 107. First, 
when PO, PI, T, TO and Tl are obtained (Step S501), whether the 

20 reference picture to which block 2 belongs is the first reference 
picture In the second reference list (or the index 0 In the list 1) or not 
Is judged (Step S502). 

As a result, when the reference picture to which the block 2 
belongs Is not the first reference picture In the second reference list 

25 (Step S502; No), the weighting coefficient is configured to be a first 
default value (Step S504). Here, "the weighting coefficient is 
configured to be a first default value" means that BWD = 1 and 
LWD=1. 

On the other hand, when the reference picture to which the 
30 block 2 belongs is the first reference picture in the reference list. 
(Step S502; Yes), whether Time Tl and Time T2 are equal or not is 
judged (Step S503). As a result, when Time Tl and Time TO are 
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equal (Step S503; Yes), the weighting coefficient is configured to be 
a first default value (Step S504); when Time Tl and Time TO are not 
equal (Step S503; No), BWDO and LWDO are calculated according to 
above-mentioned Formulas 6 and 7 (Step S505). 
5 Subsequently, whether LDWO Is larger than 7 or not is judged 

(Step S506). When it is larger than 7 (Step S506; Yes), the 
weighting coefficient is configured to be a second default value 
(Step S507). Here, "the weighting coefficient is configured to be a 
second default value" means that BWD=1 and LWD=0. On the 
10 other hand, when LWDO is 7 or less (Step S506; No), BWD and LWD 
are calculated according to above-mentioned Formulas 8 and 9 
(Step S508). 

Then, using BWD and LWD determined as described above, 
the predictive pixel value P in the block to be coded Is calculated 

15 according to above-mentioned Formula 5 (Step S509). 

In this way, when the above limitations (Steps S502, S503, 
S504, S506 and S507) or certain conditions are met, fixing the 
weighting coefficient to a predetermined value makes the number of 
calculations and required memory size of the look-up table for the 

20 weighting coefficients extremely smaller than was previously 
possible. Moreover, the required number of divisions equals to the 
value that subtracts one from the number of the weighting 
coefficients stored in the look-up table. This Is because the 
weighting coefficients of default values are used in the remaining 

25 part at the entry of the look-up table. In other words, only part of 
the weighting coefficients is determined by the calculation. 

By the way, the weighted prediction described above, 
needless to say, holds true not only when a pixel value indicates 
luminance but also when the pixel value indicates chrominance. 

30 For example, as for weighting coefficients on chrominance of blocks 
in a B picture, predictive values of the chrominance can be 
calculated by applying the offset of 128 to Formula 5 similarly to 
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Formula 3, Consequently, the calculation amount of scaling to pixel 
values of the chrominance Is also reduced compared with 
conventional scaling. 

As is described above, the moving picture coding apparatus 
5 according to the present embodiment makes the scaling processing 
using two reference blocks more efficient. The effect to reduce the 
calculation amount can be applied, needless to say, not only to the 
moving picture coding apparatus but also to a moving picture 
decoding apparatus. 

10 In addition, in the present embodiment, a method for 

realizing both of a size reduction of the look-up table required to 
avoid divisions to calculate the weighting coefficients and 
performing the weighted prediction with a predetermined significant 
bit number (16 bits, for example) at the same time is shown, but the 

15 present invention is not necessarily limited to the method for 
realizing both of the effects at the same time. Hereafter, the 
methods for realizing each of the size reduction of the look-up table 
and the weighted prediction with a predetermined significant bit 
number Individually are explained. 

20 Furthermore, in the above description, the method for 

performing the weighted prediction with the predetermined 
significant bit number by the bit sifts Is shown, but it is possible to 
use fixed values for BWD and LWD. Using the fixed values for BWD 
and LWD, the weighting coefficients may cross the significant bit 

25 number. In this instance, predetermined weighting coefficients are 
used as explained below, 

FIG. 7 is a flowchart showing significant processing steps of a 
size reduction of the look-up table required to avoid divisions to 
calculate the weighting coefficients. 

30 First, the motion compensation coding unit 107 judges 

whether generation of predictive values corresponding to the values 
of Time T, Tl and TO is necessary or not on the occasion of the 



- 15- 



weighted prediction of a B picture sliown in Figs. 2 and 3 (Step S70). 
As a result, wlien tlie motion compensation coding unit 107 judges 
the generation to be necessary (Step S70; Yes), it generates the 
predictive values corresponding to the values of Time T, Tl and TO as 
5 usual according to above-mentioned Formulas 1 to 3 (Step S72). 
On the other hand, when the motion compensation coding unit 107 
judges the generation to be unnecessary (Step S70; No), it 
configures each of two weighting coefficients WO and Wl to be 1/2 
and generates the predictive values according to above-mentioned 

10 Formula 3 (Step S71). 

Figs. 8A and 8B are flowcharts showing concrete examples of 
the judgment processing (Step S70) in FIG. 7. 

In FIG. 8A, according to whether the index of Time Tl (the 
index of the reference picture corresponding to Time T in the 

15 reference lists) is 0 or not (Step S80), the motion compensation 
coding unit 107 switches between generation of the predictive value 
using predetermined weighting coefficients (W0=Wl = l/2, for 
example) (Step S81) and generation of the predictive value using 
Time T, Tl, and TO according to above-mentioned Formulas 1 to 3 

20 (StepS82). Hereby, for example, since calculation of the weighting 
coefficients depending on time relationship is necessary only when 
the index of Time Tl is 0 is necessary, storing the weighting 
coefficients corresponding to such cases only in the look-up table 
reduces the table size compared with storing the weighting 

25 coefficients for all the occasions conventionally. 

In FIG. 8B, according to whether the index of Time Tl (the 
index of the reference picture corresponding to Time T in the 
reference lists) is a predetermined value (2, for example) or less 
(Step S85), the motion compensation coding unit 107 switches 

30 between generation of the predictive value using predetermined 
weighting coefficients (W0 = Wl = l/2, for example) (Step S86) and 
generation of the predictive value using Time T, Tl and TO according 
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to above-mentioned Formulas 1 to 3 (Step S87). Hereby, for 
example, since the calculation of the weighting coefficients 
depending on time relationship is necessary only when the index of 
a reference picture is the predetermined value or less, storing only 
5 the weighting coefficients corresponding to such cases in the 
look-up table reduces the table size compared with storing the 
weighting coefficients for all the occasions conventionally. 

FIG. 9 is a flowchart showing processing steps of performing 
the weighted prediction with a predetermined significant bit number. 

10 First, the motion compensation coding unit 107 judges 

whether generation of predictive values corresponding to the values 
of Time T, Tl and TO with a predetermined significant bit number is 
possible or not on the occasion of the weighted prediction of a B 
picture shown in Figs. 2 and 3 (Step S90). 

15 As a result, when the motion compensation coding unit 107 judges 
the generation to be possible (Step S90; Yes), it generates the 
predictive values corresponding to the values of Time T, Tl and TO as 
usual according to above-mentioned Formulas 1 to 3 (Step S92). 
On the other hand, when the motion compensation coding unit 107 

20 judges the generation to be impossible (Step S90; No), it configures 
each of two weighting coefficients WO and Wl to be 1/2 and 
generates the predictive values according to above-mentioned 
Formula 3 (Step S91). 

Figs. lOA and lOB are flowcharts showing concrete examples 

25 of the judgment processing (Step S90) in FIG, 9. 

FIG. lOA is a diagram showing a concrete example of the 
weighted prediction of a pixel value. Here, according to whether 
the difference between Time Tl and Time T (Tl — T) is within a 
predetermined range ( — 2^-2, for example) or not (Step SlOO), the 

30 motion compensation coding unit 107 switches between generation 
of the predictive value using predetermined weighting coefficients 
(W0 = Wl = l/2, for example) (Step SlOl) and generation of the 
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predictive value using Time T, Tl, and TO according to 
above-mentioned Formulas 1 to 3 (Step S102). Hereby, in 
generation of a predictive pixel value, when the weighting 
coefficients cross a predetermined value, in other words, when it 
5 may transpire that the weighting coefficients cannot be expressed 
by a predetermined bit number, the weighting coefficients are 
configured to be predetermined values (values expressed by the 
predetermined bit number), therefore the weighted prediction with 
a predetermined significant bit number is always ensured. 

10 FIG. lOB is a diagram showing a concrete example of the 

weighted prediction of a pixel value. Here, according to whether 
the difference between Time Tl and Time TO (Tl— TO) is within a 
predetermined range ( — 2~2, for example) or not (Step S105), the 
motion compensation coding unit 107 switches between generation 

15 of the predictive value using predetermined weighting coefficients 
(W0 = Wl = l/2, for example) (Step S106) and generation of the 
predictive value using Time T, Tl, and TO according to 
above-mentioned Formulas 1 to 3 (Step S107). Hereby, in 
generation of a predictive pixel value, when the weighting 

20 coefficients cross a predetermined value, in other words, when it 
may transpire that the weighting coefficients cannot be expressed 
by a predetermined bit number, the weighting coefficients are 
configured to be predetermined values (values expressed by the 
predetermined bit number), therefore the weighted prediction with 

25 a predetermined significant bit number is always ensured. 

(The Second Embodiment) 

Next, the moving picture decoding apparatus using the 
moving picture prediction method according to the present invention 
30 is explained. 

FIG. 11 is a block diagram showing the structure of the 
moving picture decoding apparatus according to one embodiment 
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using the moving picture prediction method according to the present 
invention. 

The moving picture decoding apparatus includes a bit stream 
analysis unit 201, a predictive residual decoding unit 202, picture 
5 memory 203, a motion compensation decoding unit 204, a motion 
vector storing unit 205, an addition calculation unit 207 and a switch 
208. 

The bit stream analysis unit 201 extracts various data such as 
coding mode information and motion vector information used at the 

10 time of coding from an Inputted bit stream. The predictive residual 
decoding unit 202 performs decoding to Inputted predictive residual 
coding data and generates predictive residual picture data. 

The motion compensation decoding unit 204 generates 
motion compensation picture data based on coding mode 

15 Information and motion vector information at the time of coding. 
When a block to be decoded is coded in a Inter picture prediction 
coding mode using two reference pictures, for example, the motion 
compensation decoding unit 204 obtains pixel values In two 
reference blocks from two reference pictures using a motion vector 

20 extracted by the bit stream analysis unit 201. In other words, the 
motion compensation decoding unit 204 performs the weighted 
prediction of the pixel values with the characteristic scaling 
processing according to the present Invention and obtains the pixel 
value in a block to be processed form the pixel values in the two 

25 reference blocks. Additionally, the motion compensation decoding 
unit 204 has the look-up table that associates and stores the value 
corresponding to the distance between a first reference picture and 
a second reference picture and its reciprocal. The motion 
compensation decoding unit 204 performs the scaling processing 

30 with reference to this look-up table. 

The motion vector storing unit 205 stores motion vectors 
extracted by the bit stream analysis unit 201. The motion vectors 
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stored in the motion vector storing unit 205 are referred to, for 
example, when a block to be decoded is coded in a temporal direct 
mode. The addition calculation unit 207 adds predictive residual 
coding data inputted from the predictive residual decoding unit 202 
5 and motion compensation picture data inputted from the motion 
compensation decoding unit 204, and generates decoded picture 
data. The picture memory 203 stores the generated decoded 
picture data. 

A characteristic operation of the moving picture decoding 
10 apparatus constructed as described above, in other words, the 
weighted prediction by the motion compensation decoding unit 204 
is explained. 

The motion compensation decoding unit 204 has basically the 
similar functions to the motion compensation coding unit 107 

15 included in the motion picture coding apparatus. For example, in 
the weighted prediction of a pixel value by the scaling processing, as 
is shown in FIG. 6, based on the index value of Time Tl and the 
conformity between Time Tl and Time TO (Steps S501~S503), the 
motion compensation decoding unit 204 configures default values to 

20 BWD and LWD (Steps S504, S507), identifies BWD and LWD based 
on above-mentioned Formulas 6 to 9 (Step S508) and calculates the 
predictive value in the block to be coded P using identified BWD and 
LWD based on above-mentioned Formula 5 (Step S509). 

By the way, it is acceptable that the motion compensation 

25 decoding unit 204 performs only significant processing for the size 
reduction of the look-up table required to avoid divisions in the 
calculation of the weighting coefficients as shown in Figs. 7 and 8. 
In other words, the motion compensation decoding unit 204 judges 
whether generation of predictive values corresponding to the values 

30 of Time T, Tl and TO is necessary or not on the occasion of the 
weighted prediction of a B picture shown in FIG. 2 or FIG. 3 (Step 
S70). As a result, when the motion compensation decoding unit 
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204 judges the generation to be necessary (Step S70; Yes), it 
generates the predictive values corresponding to the values of Time 
T, Tl and TO as usual according to above-mentioned Formulas 1 to 3 
(Step S72). On the other hand, when the motion compensation 
5 decoding unit 204 judges the generation to be unnecessary (Step 
S70; No), it configures each of two weighting coefficients WO and 
Wl to be 1/2 and generates the predictive values according to 
above-mentioned Formula 3 (Step S71). 

Hereby, since the calculation of the weighting coefficients 

10 depending on time relationship is necessary only when generation of 
predictive values corresponding to Time T, Tl and TO is necessary, 
storing the weighting coefficients corresponding to such cases only 
in the look-up table reduces the table size compared with storing the 
weighting coefficients for all the occasions conventionally. 

15 Similarly, it is acceptable that the motion compensation 

decoding unit 204 performs processing for the weighted prediction 
with a predetermined significant bit number as shown in Figs. 9 and 
10. In other words, the motion compensation decoding unit 204 
judges whether generation of predictive values corresponding to the 

20 values of Time T, Tl and TO is possible or not on the occasion of the 
weighted prediction of a B picture shown in Figs. 2 and 3 (Step S90). 
As a result, when the motion compensation decoding unit 204 
judges the generation to be possible (Step S90; Yes), it generates 
the predictive values corresponding to the values of Time T, Tl and 

25 TO as usual according to above-mentioned Formulas 1 to 3 (Step 
S92). On the other hand, when the motion compensation decoding 
unit 204 judges the generation to be impossible (Step S90; No), it 
configures each of two weighting coefficients WO and Wl to be 1/2 
and generates the predictive values according to above-mentioned 

30 Formula 3 (Step S91). 

Hereby, when the weighted prediction cannot be performed 
with the predetermined significant bit number using Time T, Tl and 
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TO, in other words, when it transpires that the weighting coefficients 
cross a predetermined value and therefore cannot be expressed by 
the predetermined bit number, the weighting coefficients are 
configured to be predetermined values (values expressed by the 
5 predetermined bit number), therefore the weighted prediction with 
the predetermined significant bit number is always ensured. 

(The Third Embodiment) 

Next, an example of realizing the moving picture prediction 
10 method, the moving picture coding apparatus and the moving 

picture decoding apparatus according to the present invention in 

another embodiment is explained. 

It Is possible to easily perform the processing shown In the 

above embodiments in an independent computing system by 
15 recording a program for realizing the structure of the picture coding 

apparatus or the picture decoding apparatus shown In the 

above-mentioned embodiments onto the storage medium such as a 

flexible disk. 

FIG. 12 Is an Illustration for realizing the moving picture 
20 prediction method, the moving picture coding/decoding method 
using a flexible disk that stores a program for realizing the structure 
of the moving picture coding apparatus or the moving picture 
decoding apparatus. 

FIG. 12B shows a full appearance of a flexible disk, its 
25 structure at cross section and the flexible disk itself whereas FIG. 
12A shows an example of a physical format of the flexible disk as a 
main body of a storing medium. A flexible disk FD is contained in a 
case F, a plurality of tracks Tr are formed concentrically from the 
periphery to the inside on the surface of the disk, and each track Is 
30 divided into 16 sectors Se In the angular direction. Therefore, as 
for the flexible disk storing the above-mentioned program, data as 
the above-mentioned program is stored in an area assigned for It on 
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the flexible disk FD. 

FIG. 12C shows a structure for recording and reading out the 
program on the flexible disk FD. When the program is recorded on 
the flexible disk FD, the computing system Cs writes In data as the 
5 program via a flexible disk drive. When the moving picture coding 
apparatus or the moving picture decoding apparatus Is constructed 
in the computing system by the program on the flexible disk, the 
program is read out from the flexible disk drive and then transferred 
to the computing system Cs. 

10 The above explanation is made on an assumption that a 

storing medium Is a flexible disk, but the same processing can also 
be performed using an optical disk. In addition, the storing 
medium is not limited to a flexible disk and an optical disk, but any 
other medium such as an IC card and a ROM cassette capable of 

15 recording a program can be used. 

The following is an explanation of the applications of the 
moving picture prediction method, the moving picture coding 
apparatus and the moving picture decoding apparatus as shown in 
the above-mentioned embodiments, and a system using them. 

20 FIG. 13 is a block diagram showing an overall configuration of 

a content supply system exlOO for realizing content distribution 
service. The area for providing communication service is divided 
into cells of desired size, and cell sites exl07toexll0 which are fixed 
wireless stations are placed in respective cells. 

25 This content supply system exlOO is connected to devices 

such as Internet exlOl, an Internet service provider exl02, a 
telephone network exl04, as well as a computer exlll, a PDA 
(Personal Digital Assistant) exll2, a camera exll3, a cell phone 
exll4 and a cell phone with a camera exll5 via the cell sites 

30 exl07toexll0. 

However, the content supply system exlOO is not limited to 
the configuration as shown in FIG. 13 and may be connected to a 
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combination of any of them. Also, each device may be connected 
directly to the telephone network exl04, not through the cell sites 
exl07toexll0. 

The camera exll3 Is a device capable of shooting video such 
5 as a digital video camera. The cell phone exll4 may be a cell 
phone of any of the following system: a PDC (Personal Digital 
Communications) system, a CDMA (Code Division Multiple Access) 
system, a W-CDMA (Wideband-Code Division Multiple Access) 
system or a GSM (Global System for Mobile Communications) 

10 system, a PHS (Personal Handyphone System) or the like. 

A streaming server exl03 is connected to the camera exll3 
via the telephone network exl04 and also the cell site exl09, which 
realizes a live distribution or the like using the camera exllS based 
on the coded data transmitted from the user. Either the camera 

15 exllB or the server which transmits the data may code the data. 
Also, the picture data shot by a camera exll6 may be transmitted to 
the streaming server exlOS via the computer exlll. In this case, 
either the camera exll6 or the computer exlll may code the 
picture data. An LSI exll7 included In the computer exlll or the 

20 camera exll6 actually performs coding processing. Software for 
coding and decoding moving pictures may be Integrated Into any 
type of storage medium (such as a CD-ROM, a flexible disk and a 
hard disk) that is a recording medium which is readable by the 
computer exlll or the like. Furthermore, a cell phone with a 

25 camera exll5 may transmit the picture data. This picture data is 
the data coded by the LSI included in the cell phone exll5. 

The content supply system exlOO codes contents (such as a 
music live video) shot by a user using the camera exllS, the camera 
exll6 or the like in the same way as shown in the above-mentioned 

30 embodiments and transmits them to the streaming server exlOS, 
while the streaming server exlOS makes stream distribution of the 
content data to the clients at their requests. The clients include the 
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computer exlll, the PDA exll2, the camera exll3, the cell phone 
exll4 and so on capable of decoding the above-mentioned coded 
data. In the content supply system exlOO, the clients can thus 
receive and reproduce the coded data, and can further receive, 
5 decode and reproduce the data in real time so as to realize personal 
broadcasting. 

When each device In this system performs coding or decoding, 
the moving picture coding apparatus or the moving picture decoding 
apparatus shown In the above-mentioned embodiments can be 
10 used. 

A cell phone will be explained as an example of the device. 
FIG. 14 is a diagram showing the cell phone exll5 using the 
moving picture prediction method, the moving picture coding 
apparatus and the moving picture decoding apparatus explained in 

15 the above-mentioned embodiments. The cell phone exll5 has an 
antenna ex201 for communicating with the cell site exllO via radio 
waves, a camera unit ex203 such as a CCD camera capable of 
shooting moving and still pictures, a display unit ex202 such as a 
liquid crystal display for displaying the data such as decoded 

20 pictures and the like shot by the camera unit ex203 or received by 
the antenna ex201, a body unit including a set of operation keys 
ex204, an audio output unit ex208 such as a speaker for outputting 
audio, an audio input unit ex205 such as a microphone for inputting 
audio, a storage medium ex207 for storing coded or decoded data 

25 such as data of moving or still pictures shot by the camera, data of 
received e-mails and that of moving or still pictures, and a slot unit 
ex206 for attaching the storage medium ex207 to the cell phone 
exll5. The storage medium ex207 stores in itself a flash memory 
element, a kind of EEPROM (Electrically Erasable and Programmable 

30 Read Only Memory) that is a nonvolatile memory electrically 
erasable from and rewritable to a plastic case such as an SD card. 
Next, the cell phone exll5 will be explained with reference to 
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FIG. 15. In the cell phone exll5, a main control unit ex311, 
designed in order to control overall each unit of the main body which 
contains the display unit ex202 as well as the operation keys ex204, 
is connected mutually to a power supply circuit unit ex310, an 
5 operation input control unit ex304, a picture coding unit ex312, a 
camera interface unit ex303, an LCD (Liquid Crystal Display) control 
unit ex302, a picture decoding unit ex309, a 
multiplexing/demultiplexing unit ex308, a read/write unit ex307, a 
modem circuit unit ex306 and a audio processing unit ex305 via a 

10 synchronous bus ex313. 

When a call-end key or a power key is turned ON by a user's 
operation, the power supply circuit unit ex310 supplies respective 
units with power from a battery pack so as to activate the camera 
attached digital cell phone exll5 as a ready state. 

15 In the cell phone exll5, the audio processing unit ex305 

converts the audio signals received by the audio input unit ex205 in 
conversation mode into digital audio data under the control of the 
main control unit ex311 including a CPU, ROM and RAM, the modem 
circuit unit ex306 performs spread spectrum processing of the 

20 digital audio data, and the communication circuit unit ex301 
performs digital-to-analog conversion and frequency conversion of 
the data, so as to transmit it via the antenna ex201. Also, in the 
cell phone exll5, the communication circuit unit ex301 amplifies 
the data received by the antenna ex201 in conversation mode and 

25 performs frequency conversion and analog-to-digital conversion to 
the data, the modem circuit unit ex306 performs inverse spread 
spectrum processing of the data, and the audio processing unit 
ex305 converts it into analog audio data, so as to output it via the 
audio output unit ex208. 

30 Further, when transmitting an e-mail in data communication 

mode, the text data of the e-mail inputted by operating the 
operation keys ex204 of the main body is sent out to the main 



-26- 



control unit ex311 via the operation input control unit ex304. In 
the main control unit ex311, after the modem circuit unit ex306 
performs spread spectrum processing of the text data and the 
communication circuit unit ex301 performs digital-to-analog 
5 conversion and frequency conversion for the text data, the data is 
transmitted to the cell site exllO via the antenna ex201. 

When picture data is transmitted in data communication 
mode, the picture data shot by the camera unit ex203 is supplied to 
the picture coding unit ex312 via the camera Interface unit ex303. 
10 When it is not transmitted. It is also possible to display the picture 
data shot by the camera unit ex203 directly on the display unit 
ex202 via the camera Interface unit ex303 and the LCD control unit 
ex302. 

The picture coding unit ex312, which includes the moving 

15 picture coding apparatus as explained in the present invention, 
compresses and codes the picture data supplied from the camera 
unit ex203 by the coding method used for the moving picture coding 
apparatus as shown In the above-mentioned embodiment so as to 
transform it into coded picture data, and sends It out to the 

20 multiplexing/demultiplexing unit ex308. At this time, the cell 
phone exll5 sends out the audio received by the audio Input unit 
ex205 during the shooting with the camera unit ex203 to the 
multiplexing/demultiplexing unit ex308 as digital audio data via the 
audio processing unit ex305. 

25 The multiplexing/demultiplexing unit ex308 multiplexes the 

coded picture data supplied from the picture coding unit ex312 and 
the audio data supplied from the audio processing unit ex305 using 
a predetermined method, then the modem circuit unit ex306 
performs spread spectrum processing of the multiplexed data 

30 obtained as a result of the multiplexing, and lastly the 
communication circuit unit ex301 performs digital-to-analog 
conversion and frequency conversion of the data for the 
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transmission via the antenna ex201. 

As for receiving data of a moving picture file that is linked to 
a Web page or the like in data communication mode, the modem 
circuit unit ex306 performs inverse spread spectrum processing of 
5 the data received from the cell site exllO via the antenna ex201, 
and sends out the multiplexed data obtained as a result of the 
inverse spread spectrum processing. 

In order to decode the multiplexed data received via the 
antenna ex201, the multiplexing/demultiplexing unit ex308 

10 separates the multiplexed data into a bit stream of picture data and 
that of audio data, and supplies the coded picture data to the picture 
decoding unit ex309 and the audio data to the audio processing unit 
ex305 respectively via the synchronous bus ex313. 

Next, the picture decoding unit ex309, including the moving 

15 picture decoding apparatus as explained in the above-mentioned 
invention, decodes the bit stream of picture data using the decoding 
method corresponding to the coding method as shown in the 
above-mentioned embodiments to generate reproduced moving 
picture data, and supplies this data to the display unit ex202 via the 

20 LCD control unit ex302, and thus the picture data Included in the 
moving picture file linked to a Web page, for Instance, Is displayed. 
At the same time, the audio processing unit ex305 converts the 
audio data Into analog audio data, and supplies this data to the 
audio output unit ex208, and thus the audio data included in the 

25 moving picture file linked to a Web page, for instance, is reproduced. 

The present invention is not limited to the above-mentioned 
system as such ground-based or satellite digital broadcasting has 
been in the news lately and at least either the moving picture coding 
apparatus or the moving picture decoding apparatus described in 

30 the above-mentioned embodiments can be Incorporated into a 
digital broadcasting system as shown in FIG. 16. More specifically, 
a bit stream of video information is transmitted from a broadcast 
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station ex409 to or communicated with a broadcast satellite ex410 
via radio waves. Upon receipt of it, the broadcast satellite ex410 
transmits radio waves for broadcasting. Then, a home-use antenna 
ex406 with a satellite broadcast reception function receives the 
5 radio waves, and a television (receiver) ex401 or a set top box (STB) 
ex407 decodes the bit stream for reproduction. The moving picture 
decoding apparatus as shown in the above-mentioned embodiment 
can be implemented in the reproducing apparatus ex403 for reading 
out and decoding the bit stream recorded on a storage medium 

10 ex402 that is a recording medium such as CD and DVD. In this case, 
the reproduced video signals are displayed on a monitor ex404. It 
is also conceivable to implement the moving picture decoding 
apparatus in the set top box ex407 connected to a cable ex405 for a 
cable television or the antenna ex406 for satellite and/or 

15 ground-based broadcasting so as to reproduce them on a monitor 
ex408 of the television ex401. The moving picture decoding 
apparatus may be incorporated into the television, not in the set top 
box. Also, a car ex412 having an antenna ex411 can receive 
signals from the satellite ex410 or the cell site exl07 for 

20 reproducing moving pictures on a display device such as a car 
navigation system ex413 set in the car ex412. 

Further, the moving picture coding apparatus as shown in the 
above-mentioned embodiments can code picture signals and record 
them on a recording medium. As a concrete example, a recorder 

25 ex420 such as a DVD recorder for recording picture signals on a DVD 
disk ex421, a disk recorder for recording them on a hard disk can be 
cited- They can be recorded on an SD card ex422. If the recorder 
ex420 includes the moving picture decoding apparatus as shown in 
the above-mentioned embodiment, the picture signals recorded on 

30 the DVD disk ex421 or the SD card ex422 can be reproduced for 
display on the monitor ex408. 

As for the structure of the car navigation system ex413, the 
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structure without the camera unit ex203, the camera interface unit 
ex303 and the picture coding unit ex312, out of the components 
shown in FIG. 15, is conceivable. The same applies for the 
computer exlll, the television (receiver) ex401 and others. 
5 In addition, three types of implementations can be conceived 

for a terminal such as the above-mentioned cell phone exll4; a 
sending/receiving terminal implemented with both an encoder and a 
decoder, a sending terminal implemented with an encoder only, and 
a receiving terminal implemented with a decoder only. 

10 As described above, it is possible to use the moving picture 

prediction method, the moving picture coding apparatus and the 
moving picture decoding apparatus described in the 
above-mentioned embodiments for any of the above-mentioned 
devices and systems, and by using this method, the effects 

15 described in the above-mentioned embodiments can be obtained. 

Up to this point, the moving picture prediction method, the 
moving picture coding apparatus and the moving picture decoding 
apparatus according to the present invention are explained based on 
the embodiment but the present invention is not limited to this 

20 embodiment. 

For example, the judgment In FIG. 7 (the judgment about 
whether generation of the predictive values corresponding to T, Tl 
and TO Is necessary or not; Step S70) and the judgment In FIG. 9 
(the judgment about whether generation of the predictive values 

25 with predetermined significant bits corresponding to T, Tl and TO is 
possible or not; Step S90) are not limited to the values of the 
divisors (the values of the denominators) of the formulas to 
calculate the weighting coefficients WO and Wl shown in the above 
Formulas land 2. It Is acceptable to judge with the values of the 

30 multipliers (the values of the numerators) or the values of the 
weighting coefficients WO and Wl. Further It is also acceptable to 
judge with the values of each pixel value in two reference pictures 
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multiplied by the weighting coefficients WO and Wl. 

Industrial Applicability 

The moving picture prediction method, the moving picture 
5 coding method and the moving picture decoding method according 
to the present Invention are useful as the methods for generating 
prediction values, generating bit streams by coding each picture 
that constructs a moving picture, and decoding the generated bit 
streams with a cell phone, a DVD apparatus, a personal computer 
10 and the like. 
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